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Abstract. Analyzing one example of LC circuit in [S], show its Lagrange problem only 
have other type critical points except for minimum type and maximum type under many 
circumstances. One novel variational principle is established instead of Pontryagin maxi- 
mum principle or other extremal principles to be suitable for all types of critical points in 
nonlinear LC circuits. The generalized Euler-Lagrange equation of new form is derived. 
The canonical Hamiltonian systems of description are also obtained under the Legendre 
transformation, instead of the generalized type of Hamiltonian systems. This approach 
is not only very simple in theory but also convenient in applications and applicable for 
nonlinear LC circuits with arbitrary topology and other additional integral constraints. 
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1 Introduction 

The Lagrangian and Hamiltonian formulation of nonlinear inductor-capacitor circuits (LC 
circuits) has been considered by [3-8], [TU] and the many references incited within, van 
der Schaft, Maschke and coworkers [7] and Bloch and Crouch |3] etc. established the 
Hamiltonian modeling by utilizing the constant Dirac structure of circuits. 

Many authors considered the variational approaches to nonlinear LC circuits. Based 
on the dual extremum principle in [H], Kwatny, Massimo and Bahar [B] realized the La- 
grangian modeling. Recently, Moreau and Aeyels [S] obtained the generalized Euler- 
Lagrange equations and the generalized Hamiltonian system description after applying 
Pontryagin maximum principle. At the same time, Scherpen, Jeltsema and Klaassens [10] 
established the Lagrangian modeling of nonlinear LC circuits based on the constrained 
variational principle from holonomic mechanics, see e.g. [2] etc. Then Clemente- 
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Gallardo and Scherpen [3] considered the relation between Lagrangian and Hamiltonian 
formalisms of nonlinear LC circuits via Lie algebroid. 

The Lagrangian functional in LC circuits has its own rich properties. As pointed out in 
[8] (see also [6]), the generalized velocities are not simply the derivatives of the generalized 
coordinates. In other words as in [5j, it lacks of kinetic terms for the capacitors and the 
potential terms for inductors. Utlizing the notion of tree and cotree in [TT] , [S] developed 
one method to consider nonlinear LC circuits with any topology (including with excess 
elements or without excess elements) through the Lagrangian functional 



for some matrix A. 

As shown in section 2, this Lagrange problem only have other type critical points 
except for minimum type and maximum type under many circumstances. 

In this paper, we will establish a variational principle for this Lagrange problems. 
This principle can derive the generalized Euler-Lagrange equation of new type to describe 
critical points of all types. Meanwhile, the Hamiltonian and the canonical Hamiltonian 
systems formulation will be given uniformly to describe the critical points of all types 
under the generalized Legendre transformation. 

One of the advantages of this generalized Euler-Lagrange equation formulation is that 
we can very easily derive the canonical Hamiltonian systems under the generalized Legen- 
dre transformation. In this way, the energy function can be explicitly constructed, which 
is very important especially in applications. It should be pointed out the notion of the 
generalized Legendre transformation is adapted from the ideas of H. J. Sussmann and J. 
C. Willems [H]. 

The second advantage of this generalized Euler-Lagrange equation formulation is that 
it clearly indicate the distinction between the problems without additional constraints 
and those with constraints, especially the terminal state constraints. Meanwhile, it will 
be clearly shown in this canonical Hamiltonian system formulations how the constraints 
influence the constructions of the Hamiltonian functions - the energy functions. 

The third advantage is that, in the applications to nonlinear LC circuits, we will not 
encounter the technical difficulty to consider the abnormal cases which unavoidably arising 
in applying Pontryagin maximum principle with additional constraints such as terminal 
state constraints. Meanwhile, we will also not encounter the complex calculations of 
pseudo-inverses of matrixes and Lagrangian multipliers, which involve in applying the 
dual extremal principles of [H]. 

This paper is organized as follows. In section 2, we analyze the LC examples consid- 
ered in [8j. It will be shown that the Lagrange problem with constraints has other type 
critical points except for both minimum and maximum type critical points under many 





to 



subject to the dynamics (from Kirchhoff 's current law) 




X = Au 
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circumstances; and then put forward a new type of variational problem instead of mini- 
mizing problems of the Lagrange functional. In section 3, we will establish one variational 
principle to derive the generalized Euler-Lagrange equations of new type to describe the 
critical points of all types. Some illustrative examples will be given. In section 4, we will 
derive the canonical Hamiltonian systems to describe the critical points of all types under 
the generalized Legendre transformation. Some illustrative examples will also be given. 
Last, an appendix will be attached enclosed within the proofs of the results in section 2. 

2 A New Variation Problem arising from Inductor- 
Capacitor Circuits 

L. Moreau and D. Aeyels [8j comprehensively considered the dynamic equation of one LC 
circuit as illustrative examples (see Examples 1, 2, 3 and 4 in 0). 

The associated Lagrange functional consists of magnetic coenergy (of inductors) minus 
electric energy (of capacitors) 

■J{i3,i5,i6) = /i*'[|^3ii + 1^4(^3 -^5-^6)^ + 1^5^5 + 1^6^6]^^ 

where qi and 52 are described by the dynamics (from Kirchhoff 's current law) 

(2.2) qi = is, q2 = i5 + zg. 

In addition, the following other integral constraints were imposed in [S]: 

rh rti pti 

(2.3) / isdt = A3, / i^dt = A5, / i^dt = Xq. 

J to J to J to 

In (12TT|) - (12I3I) . Ci > and C2 > are capacitance, L3 > 0, L4 > 0, L5 > and Lq > 
are inductance, i^, and iq are the currents. For more information in detailed, please see 
Examples 1, 2, 3 and 4 in [8|. 

Remark 2.1. In Examples 2, 3 and 4 of f^, it was also imposed the initial and terminal 
points constraints: gi (to), 92(^0), 91(^1)7 ^'2(^1) are fixed. It follows from (\2.2\i and (12.31) 
that, only <?i(to) (^iT'd ^72(^0) fixed can guarantee gi(ti) and q2{ti) also fixed. 

L. Moreau and D. Aeyels [8] considered the following minimum problem: 
(MP): To minimize dH]) subject to and dXB]) . 
Through defining the augmented state variables 

Xi = qi, X2 = q2, xsit) = i3is)ds, 
X4(t) = i5{s)ds, X5{t) = J^^^ i6{s)ds, 

[8] reformulated (MP) as an optimal control problem with terminal state constraints 
3^3(^1) = ^^3; 2:4(^1) = A5 and x^i^ti) = Ag, and then applying Pontryagin maximum 
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principle to obtain both the generahzed Hamihonian and the generahzed Euler-Lagrange 
model of this LC circuit. 

Let us define the symmetric matrix 



(2.4) 



^i: = 



-L4 



U + U- 2Ki 
L4 



L4 + L3 — K2 —L4 
(2.5) ^2 := I -L^ L4 + L5- 2K2 U 

— L4 L4 L4 + Lg — 2K2 

where Ki := max{K(Ci), and K2 := min{i^(Ci), ^^}. Both K{Ci) and K{C2 

are the unique solutions to 



+00 



„=1 (ti-to)^^'^'-'!'"^ 2 ^TT 01 



and 



n=l TTT^TlA^^y^^jn 2 2 



respectively. 

In the Appendix, we prove the following 

Proposition 2.1. It holds that 

(I) // the matrix Si is positively definite, then the Lagrange functional ( 12.11) subject 
to (12.21) and (12. 3p has a minimum value at the unique critical point {il,il,il) e 
C([to,ti] 



(II) // the matrix S2 is negatively definite, then the Lagrange functional (12. ip subject to 
(12. 2p and (12.31) has neither minimum value nor maximum value. 

(III) Let Ci = C2. Then K{C2) = 2K{Ci), Ki = K2 and Si = 82- In these cases, the 
Lagrange functional (12. ip subject to (12. 2p and (12. Sp has neither minimum value nor 
maximum value provided that the matrix S2 has at least one negative characteristic 
root. 

Define 

L4 + L3 —Li —L4 

(2.8) M := I -L4 L4 + L5 L4 

— L4 L4 L4 + Lg 
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(2.9) 



/ ^ \ 

^ ^ 

C'2 C2 

^ ^ / 

C'2 C2 / 



The symmetric matrix M is positively definite due to the positivity of L^, L4, L5 and Lg. 
Hence, we can define the positively definite matrice Ms and M~5 uniquely such that 



(2.10) M2M2 = M, M-2M-2 

There exists an orthogonal matrix P such that 



M- 



[2.11) 



M-2NM-^ = 




where both hi > and /i2 > are the characteristic roots of M~2 A^M~2. 
Proposition 2.2. It holds that 

(I) The Lagrange functional (12.11) subject to (12.21) and (12.31) has a unique critical point 
(il^ilil) G C([to,ti],ffi^) /or any A3,A5,A6 G M z/ and on/y zf 



(2.12) (ti - to) V /ii 7^ A;7r, and (ti - to) v/i2 ^ A;7r, VA; G M+; 

(II) // (ti — to)y/hi = kTT for some k G N"*", or (ti — to)v^ = krr for some k G N'^, 
then the Lagrange functional ( 12. ip subject to ( 12. 2p and (12. 3p /ias a critical point in 
C{[to,ti] 



(2.13) 

where 

(2.14) 
(2.15) 



/or some A3, A5, Ae G M and on/y z/ there exists b G 5itc/i t/iat 
<l>{ti - to)h = (A3, A5, Xef - / $(ti - t)M-^Sidt, 

J to 



$(t) = M^5p' 








hit) 



sm 




- gi(^o) g2(to) g2(to)xT 

Oi (_/2 <-/2 



/n t/iese cases, the Lagrange functional (12. ip subject to (12.20 and (12.30 /ias infinitely 
many critical points for these A3, A5, Ag G M. 

The notion of critical points associated with the Lagrange functional (12. ip subject to 
( 12. 2p and ( 12. 3p will be precisely given by Definition 3.1 and 3.4 in Section 3. 

From these propositions, we known the Lagrange functional (2.1) subject to ( 12.20 
and (12.30 has neither minimum nor maximum value while having critical points in many 
circumstances. The critical points in these cases we can understand as equilibriums. These 
facts suggest that we should consider the new variational problem in the next section to 
replace the minimizing problem. 
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3 A Novel Variational Principle 

In this section, we study the following variational problem: 



(3.1) J{u):= I L(x(f), M(t)) (it = stationary! 

J to 

subject to 

(3.2) x' = f{x{t),u{t)), x{to) = xo, 

where Xq G is fixed. 
It is assumed that 

(AI) L : R" X R*" ^ M and / : R" X M'" ^ M" for n,m G N+, are continuously 
differentiable; 

(All) Moreover, for any given u G C([to, ti], R"*), the system (13. 2p has a unique solution 
on the whole interval [toj^i]) which will be denoted by x{-;u). 

Obviously, the variational equation of at {x,u) G C([to, ti], R") x ^^([to, ti], R"") 
with a; = x(-; u) is as follows: 

(3.3) = ^(^x{t),u{t))5x + ^{x{t),u{t))Su, Sx{to)=0. 
at ox ou 

Let X{t\ u) with < t < ti he one fundamental solution matrix to the homogeneous 
equation of (13. 3p : 

(3.4) f = |f^^^^)'"^^))^- 

Define r(t, s; u) := X{t; u)X'^{s; u) with Iq < s < t < ti. By the variation-of-constants 
formula, the solution to (13.31) is 



(3.5) 6xit) = I T(t,s;u) — (x(s),u(s))6u(s)ds, to<t<ti. 

Jto du 



The variation of the functional J of (13. ip subject to (13.20 at m G C([to, ^i]; R™) in the 
direction h G C([to, ^i]; R™") is defined as follows 

(3.6) 6Jiu;h) :=lim ^^" + ^^^-^("\ 

e^O e 

in which J{u) is defined by (I3.1l) - (l3.2p . and 

(■ti 



dt, 



(3.7) J{u + eh)= [ L{x{t),u{t) + eh{t)) 
subject to 

(3.8) x' = f{x{t),u{t) + eh{t)), x{to) = xo 
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Somewhere in the subsequent, for E = f, L oi g, we will denote ^{x{t),u{t)) (and 
||(x(t), ■u(t))) simply by j^{t) (and ^(t)) respectively, and analogously for other time 
variables such as s, r, etc. 

Applying (13. 5p to (13. 7p - (13.81) . we can deduce by Fubbi Theorem that 

J{u + eh) — J{u 

tn dx Ito '^i^ ' ' ' ou ^ ' ^ ' Jin 

(3.9) = e r C §imt, s; u) dtf^{s)h{s) ds + e ^imt) dt + o{e) 
ft It §i^)ns, t; u) ds^l{t)h{t) dt + e fj 



^ It f W It nt, s; n)|f(.)/i(.) dsdt + e ^{t)h{t) dt + oye) 



^ "it It fMns. t; u) dsi{t)h{t) dt + e]^; f (t)Mt) dt + oie) 
= ^ it lit §i^)ns, t; u) dsfSt) + f dt + 0(e), 

for any h G C([to, ti]; K™), and then we have 

[ ^{s)T{s, t- u) ds'git) + ^{t)]h{t) dt. 

3.1 The first case with additional constraints 

Let us impose some additional constraints 

(3.11) f [Bu{t) + a]dt = Q, 

J to 

where i? G M'^"* is a matrix and a G is a vector for / G N"*". 
Definition 3.1. (I) The admissible set is defined as 

(3.12) W,rf = {«GC([to,ti],M'")| [\Bu{t) + a]dt = 0}; 

Jto 

(II) The set of allowed variations is defined as 

(3.13) Varf = {/iGC([to,ti],M™)| Bh{t)dt = 0}. 

Jto 

Definition 3.2. u G Uad is called a critical point for the Lagrange functional (13.11) subject 
to the equation (13.21) and the constraints (13.111) provided that 

(3.14) 6J{u,h) = 0, yheVad. 

In this case, we call the Lagrange functional (13. ip subject to the equation (13. 2p and the 
constraints (13.111) is stationary at this u G Uad- 

Obviously, u G Uad is a critical point for (13.11) subject to (13. 2p and (13.1 ip provided that 
(13. ip subject to (13. 2p and (13. lip attaches the minimum (or maximum) value at this u. 

In classical mechanics, the equation (13. 2p is the simplest form as x' = u. 6u = 6{x') 
uniquely determine Sx. Conversely, 6x also uniquely determine 6u. So we usually refer 
the notion of critical points to x instead of u in that case. For general cases of (13.20 . 6x 
not always uniquely determine 5u, which can be discovered from the dynamic equation 
(12. 2p of the LC circuit example in Section 2. 

The generalization of Hamilton's principle in classical mechanics to the variational 
problem of (13.10 subject to (13.20 and (13. lip is as follows: 
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Definition 3.3. {x,u) with x = x{-,u) is called a generalized motion of the Lagrange 
functional (13. ip subject to the equation (13.21) and the constraints fl3.1ip provided that 
u G Uad is a critical point for (13. ip subject to (13.20 and (13. lip . 



This principle is miglit as well called the Hamilton's type principle. 

Theorem 3.1. {x,u) with x = x{-,u) is a generalized motion of the Lagrange functional 
(13. ip subject to the equation ( 13. 2p and the constraints (13. lip , if and only if {x,u) satisfy 
both the constraints (13. lip and the generalized Euler- Lagrange equations 



(3.15) 



■ f (x(t), «(t)) + §{x{s),u{s))T{s, t; u) dsf^{x{t),u{t)) = fi^B, 
x'{t) = f{xit),uit)), to<t<ti, 



for some ^ G M'. 

Proof Let us denote the row vectors of the matrix B by 
(3.16) hi := {bii,bi2,- ■ ■ ,bim), z = 1,2, 



Define that / functions as follows 

(3.17) Ht) = bJ, tG[to,ti], 
and 

(3.18) L{B) ■.= span{bi,b2r-- M, 

which is a complete subspace of L^{to,ti;R"'). L2(to,ti;M™) = L{B) © L{B)^ where 
L{B)-^ is the orthogonal complement space of L{B) in L'^{tQ,ti;W^). It is well known 
that C{[tQ,ti],W^) is imbedded in L'^(to,ti;M"^) continuously and densely. Similarly, Vad 
is also imbedded in L{B)^ continuously and densely. Hence, (13.140 yields that (13.150 . □ 



Corollary 3.1. {x,u) with x = x{-;u) is a generalized motion of (13.10 subject to (13.20 if 
and only if {x, u) satisfies the generalized Euler- Lagrange equations 



(3.19) 



^{x{t),u{t)) + ^{x{s),u{s))T{s, t- u) dsl^{x{t),u{t)) = 0, 
x'{t) = f{x{t),u{t)), to<t<t^. 



Example 3.1 In classical mechanics, f{x,u) = u yields that |f(t) = T{s,t]u) = J„. If 
the initial state x{to) = G is fixed while the terminal state x{ti) is free, then the 
generalized Euler-Lagrange equation (I3.19P reduces to 

(3.20) ^(a;(t),x'(t))+y^ ^(a;(s),x'(.))c/s = 0, 

as one necessary and sufiicient condition for the motion x G C^([to, ^i], I^")- 
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If the terminal state x{ti) = xi & M" is also fixed, which can be reformulated as the 
constraints (I3.1ip with B = In and a = —^z^- The trajectory x with x(to) = Xq and 
x{ti) = xi is one motion, if and only if x satisfy the equation (13.151) . which reduces to 



(3.21) 



^^■j{x{t),x'{t)) + ^{x{s),x'{s)) ds = fi, 



dx' 



for some /i G M". 

Differentiating with respect to t, both ( ]3.20p and ( ]3.2ip yields the classical one 



(3.22) 



|[^(x(t),x'(t))]-|^(x(t),x'(t)) = 0. 



If some components of the terminal state are fixed while the others are free, then the 
generalized Euler-Lagrange equation (13.151) is better than the Euler-Lagrange equation 
(I3.22P just as the case without terminal state constraints. 



Example 3.2 For the LC example of (^-(^, let 



X :- 



u :- 



L{x, u) = \L^il + 1^4(23 - is - iaf + \L^il + ^Lgz^ - i^ql - i^ql and 



2C2 



f{x,u) 



Hence T{t,s]u) = I2. The equation (I3.19p is 





(3.23) 



(L3 + U)i^{t) - LMt) - LMt) - It ^ ds 
-Ui^it) + (L4 + L5)z5(t) + L^ieit) - 



t Ci 

-LMt) + LMt) + {L, + LMt) - ft ^ ds 
i5 + id- 



0, 
0; 



For the LC example of (I2.ip - (l2.2p with the terminal state (q'i(ti), ^'2(^1)) fixed, can be 
reformulated as the constraints (13. lip with B = A, the equation (13.150 is 



(3.24) 



(L3 + L^Mt) - ui^it) - L^t) - /; 

-Lii^i^t) + (L4 + L^)i^{t) + L4is{t) - ft Ci 



"^cf^ ds — fJ-l: 

'^iiMds- f!' ^ ds 



-LMt) + LMt) + {U + L,)t,{t) - Jt '4rd^- It ^ ds 



C2 

12{s] 
C2 



1^2 



«5 + ie, 



for some /ii, /X2 £ 

For the LC example of (I2.ip - (l2.3p . the constraint (12. 3p can be reformulated as the 
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constraints fl3.1ip with B = I^. The equation (I3.15P is 

' (L3 + L,)isit) - LMi) - LMt) - l!" '-^d^ = f^u 

(3.25) I -LMt) + LMt) + {U + L,Mt) - t "-^ds- //^ '-^ ds = /ig; 
q'i = is, 

^^2 = ^5 + ^6, 

for some /ii, ^^21 /"a ^ ^■ 

Since the matrix M defined by (12. 8p is positively definite, by letting u = is — — ie, 
all (I3.23p . (13.240 and (I3.25P yields the same equations 



(3.26) 



LMt) + LMt) + 



0, 



-LMt) + LMt) + '-€ = 0, 



C2 

-LMt) + LMt) + '-^=0; 



q2 = i5 + i& 

H = is - k - id, 



which is just the generalized Euler-Lagrange equation (3.40)-(3.41) in [8]. 
Example 3.3 For the electromechanical system in |8j (see Example 7), 

Liu) = J {^Liil + -Liil + -mfu^ - + mgl cos{e)} dt 



9 = u. 



'to 

subject to 

q = ii +12, 

where x := {q,0)'^, u := {ii,i2,M- Then L{x,u) = \Lii\ + \L2il + ^mPuj'^ - 
mgl cos{0) and 



+ 



If without additional constraints, then the equation (I3.19P is 



(3.27) 



iLMt)-t^)ds = 0, 
LMt)-Jt^)ds = 0, 

mfuit) - J''[mglsm{9) - 2^C''(^)] ds = 0; 



e' = u. 
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If the terminal point is fixed, which can be reformulated as the constraints (13.111] with 
B = A, then the equation (I3.15P is 



(3.28) 



Liii{t) - It' -^ds = /ii, 

^2^2 (t) - l!' ds = fii, 

mPuj(t) — JI^^ [mgl sm(9) - 
q' = ii +i2, 

6' = L0. 



2C2(6») 



C'{9)] ds = fi2; 



for some G M. 

If with the integral constraints 



(3.29) 



ii dt = Xi, 



to 



%2 dt = A2, 



to 



udt = A3, 



to 



which can be reformulated as the constraints (13. lip with 3 = 1^, and can guarantee the 
terminal point fixed (similar to Remark 2.1), then the equation (I3.15P is 



L2i2{t) - ^^ds 



(3.30) 



q' 

6' 



for some /ii,/i2,/^3 £ 

Differentiating the three equations (I3.27p , (13.281) and (I3.30p yields the same generalized 
Euler-Lagrange equation (5.7) in [S]. 



3.2 The second case with additional constraints 



Consider the Lagrange functional (13.11) subject to the dynamic equation (13. 2p and some 
additional constraints 



(3.31) 



where g : 



g{x{t),u{t))dt = 0, 



to 



with / G N"*" is continuously different iable. 



Let C([to, ^i], K™) be the Banach space equipped with the usual maximum norm 



Denoted hj Vk ^ v in L'^{to, t 



the weak convergence of Vk to v in (to , t 



Definition 3.4. For arbitrary given xq G M", the admissible set at xq is defined as 

Uad{XQ) ■ 



(3.32) 



{u e C([to,ti],M'")| the solution x{-,u) to flO) 
together with u satisfy the constraint (I3.3ip }. 
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Let Bi be the unit ball in C([to, ^i], K™), which is a convex set closed under the strong 
topology of -L^(to) ^I'l K™)- It follows from Mazur theorem that Bi is also closed under the 
weak topology in L'^{to,ti;W^). Meanwhile, Bi is weakly precompact in L'^{to,ti;W^). 

Hence, for any sequence {wfc}^^ C Uad{xo), {j:^^E^}k=i *^ -^i admits a subsequence 
weakly convergent to some h E Bi. In this way, we can define the notion of allowed 
variation as follows: 

Definition 3.5. For any given Xq G and u G Uad{xo), h G C([to, ^i], K™") is called an 
allowed variation along u at Xq provided that there exists {zxfc}^^ C Uad{xo) such that 



(3.33) 



Uk^u in C([to,ti] 



r); 



h in L^(to,ti;M"^) 



llufc-wllc 

The set of all allowed variations along u at xq is denoted by Vad{,xo,u). 
Proposition 3.1. For any given Xq G M" and u G Uad{xo), 

i 

'to Jt 



(3.34) r [ r ^{s)T{s, t- u) ds^it) + ^it)]Kt) dt = 0, V/i G VU^o, u). 



Proof 

Let {ukjt^^ C Uad{xo) satisfy (13.3311. and define Sk ■= \\uk - u\\c, hk := j^^^E^, then 

= J^*^ g{x, Uk) dt — j^^ g{x, u) dt 

= ^^H; lf(0 II «)ff(^)/i^(^) dsdt + s fjt)hk{t) dt + oisk) 

o.^ = it t ^.imt, s; u) dtfjs)hk{s) ds + e ^Jt)hk{t) dt + o{ek) 

= ekj::J!'^Js)ns,t;u)dslL{t)h,{t)dt + eJl^^Jt^^^^^^ 

= it Ut f^ns, t; u) dsf^it) + fMhk{t) dt + o{ek) 

= it ilt f^ns, t; u) dsf^it) + fMKt) dt + o{ek). 

Hence we have (13.341) . □ 

Analogous to (13.351) . let {ma:}^^ C Uad{xo) satisfy (I3.33p . we have 

361 - •^(«) = It ^fc) dt - It ^(^' ^) dt 

= eki:X'fMT{s,t-u)ds'£{t) + fMmdt + o{ekl 

for any h G Vad{,XQ,u). 
Thus, we define that 

Definition 3.6. u G V(ad{xo) is called a critical point for the Lagrange functional (13.11) 
subject to the equation (13.21) and the constraints (13.311) provided that 

(3.37) 6J{u; h) = 0, V/i G Vad(xo, u). 

In this case, we call (13.11) subject to (13. 2p and (I3.3ip is stationary at this u G Uadi^o)- 
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Definition 3.7. {x,u) with x = x{-,u) is called a generalized motion of the Lagrange 
functional (13. ip subject to the equation (13.21) and the constraints fl3.3ip provided that 
u G Uad{xo) is a critical point for (13. ip subject to (13. 2p and (I3.3ip . 

Theorem 3.2. {x,u) with x = x{-,u) is a generalized motion of the Lagrange functional 
(13. ip subject to the equation i \3.2\) and the constraints (13.310 provided that (x, u) satisfy 
(I3.3ip and the generalized Euler- Lagrange equations 



(3.38) 



■ f W - W + It [f (^) - f^^'lisms, t- u) dsf^t) = 0, 
x\t) = f{x{t),u{t)), to<t<ti, 



for some /i G M'. 

Proof Combining the generalized Euler-Lagrange equation (13.380 and (I3.34p yields 
(I3.37p . The proof is completed. □ 



4 The canonical Hamiltonian systems 

4.1 The case without additional constraints 
(Allla) The equation 

(4.1) = /^(x,n)-— (a;,n), 
admits one smooth solution 

(4.2) u = ^{x,p), V(x,j9) G M" X R'^. 
Define the pseudo Hamiltonian 

(4.3) J^{x,p,u):=p^f{x,u)-L{x,u), V(x, jo, n) G R" x R" x 
and define under the assumption (Allla) the Hamiltonian 

(4.4) H{x,p) := J^{x,p, (p{x,p)), V(x,p) G R" x 
which is called the generalized Legendre transformation of J^. 
Remark 4.1. The Legendre transformation of is defined as 

H{x,p) := max^(x,j9,M), V(x,p) G R" : 



nn 



The definition of (14. 4p is adapted from (Al) in fT^ (p. 39), which indicates there maybe 
exist different Hamiltonian descriptions for the same equilibrium in nonlinear LC circuits. 
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Suppose that {x,u) is one solution to the generahzed Euler-Lagrange equation fl3.19p . 
Let 

(4.5) p{tf:=- —{x{s),u{s))T{s,t-u)ds, t e [to,h], 



t dx 



then ( 13.19P can be recast as 
(4.6) 



p(t)^|f(x(t),^.(t))-|^(x(t),«(t)) = 0, 



x'{t) = f{x{t),u{t)), te[to,t^]. 
It follows from the first equality of (14.61) and the definitions of H and that 



^^(x(t),p(t),t.(t)) = f (x(t),p(t)), 



Meanwhile, the second equality of (14.61) yields that 

(4.8) x'{t) = f{x{t),u{t)) = ^{x{t),p{t),u{t)), 

and differentiating (14.51) yields that 

U 9) [^'(^)]^ = f (^W' «W) + C '^{^{s)Msms, t; u) ds%ix{t),u{t)) 



dx 

Hence, we have 



mx{t),p(t)Mt)). 



Theorem 4.1. Let the assumption (Allla) holds. Suppose that {x,u) is one solution to 
the generalized Euler-Lagrange equation (I3.19p . then {x,p) given by (14.51) is one solution 
to the canonical Hamiltonian system 



(4.10) 



x'{t) = VpH{x,p), x{to) = xo, 

yit) = -W,H{x,p), p{ti) = 0. 



Conversely, if{x,p) is one solution to (14.101) . then {x,u) given by (14. 2 p is also one solution 
to the generalized Euler-Lagrange equation (I3.19p . 

4.2 The cases with additional special constraints 

In (I3.3ip . let us assume that there exists some matrix Q G M'^" and P eMJ such that 

(4.11) g{x,u) = Qf{x,u) + (3, V(x, n) e R" x R'". 

Remark 4.2. The terminal state constraints with x{ti) = xi fixed, can be reformulated 
as fHTTD with Q = L^ and P = -fE^- 

If there exist A G R"^™, B G R'^™ and a G R^ such that f{x, u) = An and g{x, u) = 
Bu + a, then (14.111) is equivalent to 

( A 

(4.12) rank(A) = rank 

V B 
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Let 



(4.13) p{t f := - [^{s) - ^^T^(s)]T{s, t; u) ds + /x^Q, 

for the parameters /i = (/ii, ■ ■ ■ G M'. Then, f l3.38p can be recast as 



(4.14) 



p(t)^|{(x(t),^x(t))-f (x(t),^t)) = 0, 
x'(t) = f{x{t),u{t))- 



Theorem 4.2. Assume that both (14.111) and the assumption (Allla) holds. Suppose that 
{x,u) is one solution to the generalized Euler-Lagrange equations (13.381) . then {x,p) given 
by (I4.13P is one solution to the Hamiltonian system 



(4.15) 



x'{t) = VpH{x,p), x{to) = xo, 

''{t) = -V^H{x,p), P{ti) = Q^/i, 



where the Hamiltonian H is defined in (14. 4p . 

Conversely, if {x,p) is one solution to (14.151) . then {x,u) given by (14. 2 p is also one 
solution to the generalized Euler-Lagrange equation (13.380 for the parameters /i G M'. 

4.3 The general cases 

Define the pseudo Hamiltonian 

J^{x,p,u;iJ,) := p^f{x,u)-L{x,u) + fi^g{x,u), 
^ ■ ' V(x,p, u, /x) e R'' X X M*" X M'. 



(Alllb) The equation 



(4.17) = p' ^{x, u) - — (x, u) + ^(x, u), 
admits one smooth solution 

(4.18) u = (^(x,p;/i), V(x,p) G X M'^, 

for some parameters /x = (/ii, ■ ■ ■ , ^i)^ G M}. 

Under the assumption (Alllb), let us define the Hamiltonian 

(4.19) H{x,p]n):=Jif{x,p,^{x,p]^y,fi), V(x,j9) G M" x M". 

Suppose that {x, u) is one solution to the generalized Euler-Lagrange equation ( 13.380 
for these parameters /x G M'. Let 

[—{x{s),uis)) - f^^-^{x{s), uis))]T{s, t; u) ds, 

then the generalized Euler-Lagrange equation (13.380 can be recast as 
p(t)^|f(a:(t),tx(t)) - f (x(t),tx(t)) + ^,^^{x{t),u{t)) = 0, 



du ^ V / ' V / 7 Qu V V 7 ' V / 7 Qu 

x'{t) = f{x{t),u{t)), te[to,t,]. 



(4.21) 

Similar to the proof of Theorem 4.1, we have 
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Theorem 4.3. Let the assumptions (Alllb) holds. Suppose that {x,u) is one solution 
to the generalized Euler- Lagrange equation (13.381) for the parameters /i G M', then {x,p) 
given by fl4.20p is one solution to the Hamiltonian system 



(4.22) 



x'{t) = VpH{x,p;iJ,), x{to) = xo, 

p'it) = -V,H{x,p;fi), p{ti)=0. 



Conversely, if {x,p) is one solution to fl4.22p for the parameters /i G M} , then {x,u) 
given by f l4.18p is also one solution to the generalized Euler- Lagrange equation (13.380 . 

Remark 4.3. From Theorem 4-i, Theorem and Theorem 4-3, we can find out that 
the canonical Hamiltonian is not enough to describe the energy function and the dynamic 
equation when the constraints (I3.3ip become more complex. 

Example 4.1 (Continued from Example 3.1) The Hamiltonian is as usual defined by 
H{x,p) = maXugiRn {p'^M — L{x,u)}, and it follows from Theorem 4.1, that the dynamic 
system without additional constraints is described by the two-point boundary value prob- 
lem of the canonical Hamiltonian system. 

Two different description of the Hamiltonian system. The first is the classical ap- 
proach. Applying Theorem 4.2 yields 



(4.23) 



x'{t) = VpH{x,p), x{to) = Xo 

p'{t) = -V^H{x,p), Pih) = Pu 



where the terminal costate pi G MJ^ are the parameters such that the terminal state 
constraints x{ti) = Xi satisfied. The second is applying Theorem 4.3. 



(4.24) 




VpH{x,p;fi), x{to)=xo 
-\/^Hix,p;fi), P{ti) = 0, 



where the Hamiltonian H{x,p; fi) = maXu^R^^p'^u — L{x, u) + fJ^'^u}, and /i G M" are the 
parameters such that the terminal state constraints x{ti) = xi satisfied. 

In fact, H is the energy function and H is the energy function with constraints. 
Example 4.2 (Continued from Example 3.2) The Hamiltonian is 

H{x,p) = max(i3,ig,ig)6R3{piZ3 + p2(«5 + ie) - ^L^ij 

-|L4(i3 -i5- - \L^il - \L^il + 2^g? + 2^?!} 
(P.\ 

= l{Pl,P2,P2)M M P2 +2k'^I+2k^l 

where M is the positively definite matrix defined by (12. 8p . Then applying Theorem 4.1 and 
Theorem 4.2 to this Hamiltonian, we obtain the canonical Hamiltonian systems descrip- 
tion of this model without additional constraints and with the terminal state constraints, 
respectively. 
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The Hamiltonian is 



—Lsij - iL4(z3 - is - tef - \L^il - \L^il + + ^^g^j 

/ Pi + /^i \ 

\P2 + f^S J 

where M is the positively definite matrix defined by fl2.8p . Then applying Theorem 4.3 to 
this Hamiltonian, we obtain the canonical Hamiltonian systems description of this model. 
Intuitively, the original energy function is not enough in general to describe the dynamic 
system with constraints since the constraints involves three parameters /ii,/i2,/^3 while 
the dimension of the costate is only 2. 

Example 4.3 (Continued from Example 3.3) The Hamiltonian is 

H{x,p) = max(j^_i2^^)gK3{pi(zi + 12) + P2UJ - ^Liij - \L2il - \mfuj'^ 

2 

+ 2C(e) ~ mgl cos{e)} 
= UtI + T-M + 2W^P'2 +2m~ "^alcosiO). 

Then applying Theorem 4.1 and Theorem 4.2 to this Hamiltonian, we obtain the canonical 
Hamiltonian systems description of this model without additional constraints and with 
the terminal state constraints, respectively. 
The Hamiltonian is 

H{x,p) = max(i^,i2,<^)gK3{(pi + /ii)zi + {pi + ^2)^2 + (P2 + /^s)^ 
— \Liil — \L2i\ — \mfuj'^ + — mglcos{9)} 
= 2ir(^'i + /^i)^ + ^(P^ + ^2)^ + 2^{P2 + /is)^ + 2^ - mgl cos{e). 

Then applying Theorem 4.3 to this Hamiltonian, we obtain the canonical Hamiltonian 
systems description of this model. Similarly, the original energy function is also not 
enough in general to describe the dynamic system with these constraints fl3.29p . 

5 Appendix 

Let L2(to, h; R) be the Hilbert space equipped with the inner product 

2 Z"*^ 

(5.1) {u,v) := / u{t)v{t)dt, yu,v e L'^{to,tuR), 

h — to J to 

and define eo, e„, G L^(to,ti; R^ for n G as follows: eo(t) = and 

(5.2) e„(t) := cos ~ ^ e~ (t) := sin ^^^(^ ~ ^0) ^ t ^ ^t^^ t^]^ 
then {eo, ei, el, 62, 62, ■ ■ ■ , e^, e^, ■ ■ ■ } is an orthonormal basis of L'^{to, h; R). 
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The constraint (12.31] yields that 

(5.3) ik = j^^^eo + ^{ak,nen + bk,nen), 

with EnZKn + bin) < +00, for k = 3,5, 6. 
Through direct calculations, we have 

Lemma 5.1. The Lagrange functional (12. ip subject to (12.21) and (\2.3\i can be represented 
as follows: 

(5.4) J(^3,^5,^6) = Q + L + N, 
where 

Q _ to)L4, J2n=lici3,n — 0'5,n — 06,n)^ 

4 Z^n=l "3,n 167r2Ci Z^n=ll^^/ J 
, \ {ti-to)Ls y^+oo 2 I (ti-to)L6 v^+oo 2 (fi-fp)^ y^+oo / as. n+ae.n N21 1 

"r[ 4 Z^n=l "5,n "T 4 Z^n=l "6,n 167r2C2 Z^n=lV n / Jj 

(5.5) +1 (ilzM^ E:ri(f>3,n - 65,n - ^S.n)^ 

. r (fi-fo)i^3 y^+oo ,2 _ (ti-tp)^ v^+oo / fe3,n \2 _ (ti-tp)^ /y^+oo fe3,,i \2l 

. r (fi-fo)L5 y^+oo ,2 , (fi~-to)L6 y^+cxD ,2 
"•"[ 4 Z^n=l '^5,n "T 4 Z^n=l '^G.n 

(fl-fp)^ y^+00 / bs.n+be.n N2 _ (fl-tp)^ /y^+OO bs.n+be.n N2] ] 



(5.6) 



■%g^[2gi(to) + A3]Eri%- 
-%g^^[2g2(to) + A5 + A6]E:ri^^ 



N = 2(7I37^[^3A2 + L,\l + LgA^ + L4(A3 - A5 - 



(5.7) _k_^o[3^^(^^)2 + 3^^(^^)_^^ + ^2 



6C2 

Lemma 5.2. Lei a > and /? > 0. T/ien 



^[3g2(to)' + 3g2(to)(A5 + Ag) + (A5 + 



+00 2 +°° +°o 

(5.8) 

1 1 1 

71=1 n=l n=l 

where K is the unique solution to the equation 

+00 _ 

(5.9) /^E^-^ = l' ^>« + /3- 



Ktl^ — a 

n=l 



The equality in (15. 8p holds if and only if x„ = for arbitrary C G 

n 

Proof 



+00 2 +°° 



E + CX3 2 1 ^ ^ 

n^l ^n — n=l n=l 
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For / G N+, it can be shown by Lagrange multiplier rule that the problem: 
To maximize a ZLi § + /^(ELi 

subject to J2n=l = 1 



has only two solutions 

I 



where 



k= max + 

Z^n=i-^n n=l n=l 



satisfies 



n=l ' 

Obviously, it follows from lim^^+oo h = K that, the equation fl5.9l) and 

+ 00 ^ 1 

< := ^hm = ±E (^;^]-^;^, n e N^ 

ji=l ^ '^ 



n=l 71=1 71=1 n=l 

which implies the sufficiency. 

The necessity can be shown directly by Ljusternik Theorem (the Lagrange multiplier 
rule in infinite dimensional space, see pp.290 in [U]). □ 

Similarly, we have 
Lemma 5.3. Let a > and P > 0. Then 

(5.10) a y: ^"^^ ir + ^^)' ^ ^(E + E ?^")' 

71=1 n=l n=l 71=1 

where K is the unique solution to the equation 

(5.11) 2PJ2 2 o i^>2(a + /3). 

n=i - 2a 

The equality in (15.101) holds if and only if Xn = Vn = 2a for arbitrary C G M. □ 
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(5.13) 



Proof of Proposition 2.1 Let Q := Qi + Q2, where 

y^-^"^) 4 Z^n=l"3,n i67r2Ci Z^n=ll~J J 

">"[ 4 Z^n=l "5,n "T 4 Z^n=l "6,n 167r2C2 ^n=lV n /J' 

, r (fi-to)L3 ;2 _ (ti-tp)^ / 63,n N 2 _ (ti-tp)^ /y^+oo fca.n N21 

"!"[ 4 Z^n=l '^S.n 167r2Ci Z^n=ll n ' Stt^Ci vZ^n=l n ' J 

I r (*i-*o)-^5 V^+oo ,2 _|_ (ti-to)I/6 V^+oo 7 2 

"!"[ 4 Z^n=l "5,n "t" 4 Z^n=l "6,n 

(tl-tp)^ / fes.n+fce.n \2 _ (tl-fp)^ /V^+OO bs.n+fee.n \21 

167r2C2 ^n=ll n 87r2C2 V^n=l n ) \- 

(I) By Lemma 6.2 and 6.3, 

^^3^Q2 = 1^4 Ylt=li^'i,n — h,n " &6,n)^ 

_l_rr Y^+oo ,2 (fi-fp)^ Y^+oo / ba.n ^2 (ti-fo)^ /v^+oo fe3.n N21 

fC; l/l'l (il-tp)^ Y^+OO /fcs, 71+66, n \2 (tl-tp)^ /V^+OO fe5,„+66,n \2l 

' i;^^ 2^n=l[ n ) ~ 2n^C2 y^n=l n )\ 

= En=l(^3,n5 &5,n5 ^6,n)5'i(b3,„, fes^rn ^6,n) • 

If 5*1 is positively definite, then it follows from f l5.14p that Q2 is a coercive quadratic func- 
tional, which guarantees Qi is also coercive. Thus Q is a coercive quadratic functional, 
which yields that the Lagrange functional (12.11) subject to (12.21) and (12. 3p has a minimum 
value at the unique critical point G L'^{to,ti;M^^). Following the approach to 

indefinite linear quadratic optimal control problems in [H], we can prove any optimal 
control are continuous, which yields that G C([to, ^i]; K^)- 

(II) Let 



(5.15) ^ ^5 = En^l ^5,ne„ 

^6 X!]n=l b(>,n^n 





47r2CiX(Ci)n2- 




-tp)2 


27r2C2n 






2tt2C2K(C2W- 


(ti 


-tp)2 


2TT^C2n 






27r2C2X(C2)n2- 




-tp)2 



2 '^n: 



Lemma 6.2 and 6.3 yields that 

4 QI 

= h'^{L4 Yln=lib3,n — ^5,n ~ ^6,n)^ 

+ [^3 - i^(Cl)] Kn + [^5 - K{C,)] C + [^6 - K{C,)] YZ=1 Kn} 

+ [^3 -/iES + 2i^2]E:ri fe5,n' + [U - 2i^2] &6,n'} 

y < 0, 

which implies lim/i^oo '/(^3, ^5, ^e) = —00. So it follows from the density of C([to, ii]; K^) in 
L^(to, ^i; IR^) that the Lagrange functional (12.11) subject to (12.21) and (12.31) has no minimum 
value. 
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(Ill) If Ci = C2, then K{C2) = 2K{Ci), Ki = K2 and = S2. If ^2 has at least one 
negative characteristic root, then there exist at least one unit vector {x,y,z) such that 



{x,y,z)S2ix,y,z) <0 



Let 



" Y2n=l ^3,nGn 
(5.16) {^5 = T.n=lb5,nen 



/it iTT^Cm ~ 

"■■^ l^n=l 47r2CiX(Ci)n2-(ti-to)2'^'^' 

"'U l^n=l 47r2Cii^(Ci)n2-(ti-to)2'^"' ^ 

l,yV^+oo 47r2Cir 

"-^ Z^n=l 47r2CiE'(Ci) 



L)n2-{ti-to)2^"' 

Analogous to the proof of (II), Lemma 6.2 and 6.3 yields that 

which implies lim/i^oo -^(^3) ^5, ie) = — cxd. So the Lagrange functional (12. ip subject to (12.21) 
and (12.31) has no minimum value. □ 

Proof of Proposition 2.2 By Fubini Theorem, it follows from (12. ip and (12. 2p that 

J {is + e6i3, Z5 + edi^, % + ^^k) - Jih, ^5, 
= e /^*'{[L3Z3 + L4(z3 - Z5 - ifi)]5i3 - ^(gi(to) + is dr) //^ ds} dt 
+e /j*' [Lsis + L4(i5 + ze - ^3)]'^^5 

l!n A [^2 (to) + Jl {i5 + ie) dr] j! di^ ds dt 



(5.17) 



+£ /^^' [Lgie + ^4(^5 + ^6 - «3)]'5«6 

~^ l!o h [^2(^0) + /t* (^5 + ^e) c^T-] /t* <5i6 rfs + o{e) 
= ^ l!o [^3^3 + ^4(^3 - ^^5 - ^e) - ^ It' (Qiito) + 13 dr) dsjSi^ dt 

+e /i*H^5^5 + ^4(^5 + ^6 - ^3) - ^ //° [52(^0) + /tj(^5 + ie) dr] dsjSi^ dt 
+^ ItoiLeie + ^4(^5 + ^6 - ^3) - ^ //°[?2(to) + /^^(^s + ^e) c?-^] dajSi^dt 
+0(5). 

The constraints (12.30 yields that 

(5.18) Sis e Ml, Si^eUi, e Hi, 
where 

+00 +00 
Hi := {^(a„e„ + 6„e;)| ^(a^ + b^) < +00}, 

ri=l n=l 

and Ho := {aeo| a G M}, then L'^{to, ti, M) = Hq © Hi, i.e., Hq is the orthogonal comple- 
ment space of Hi in L^(to, ti; K). 

Hence, we have from (15.170 . (I5.18P and L^(to, ti;M.) = Hq © Hi that there exist some 
hihJe such that (23, i^, -ig) satisfy (12. 3p and 

^3^3 + -^^4(^3 -ib-ie) - Jt' [qi{to) + is dr] ds = I3, 

(5.19) <j Lgzs + L4(i5 + ^6 - ^3) - ^ jt"[Q2{to) + //^(^5 + ^e) c^r] rfs = k, 
Laid + Li{i^ + «6 - ^3) - ^ [^2(^0) + //q(«5 + dr] ds = k, 
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if and only if (^3, i^, Zg) is a critical point for the Lagrange functional (12. ip subject to fl2.2l) 
and (12.31) . Through setting 



xi{t) := / i^dr, X2{t) := / i->dT, 0:3 (t) : 



to 



to 



dr, 



to 



it follows from the equation (15.191) and (12. 3p that 

(L4 + L3X - - L^x'^ + ^x, + '-^ 



Ci 



(5.20) 



-L4X;' + UX'I, + (L4 + i:6)x'3' + + cfe^3 + ^ 



0, 
0. 



with the boundary condition 

2^1 (io) = 0, X2(to) = 0, 0:3(^0) = 0, 

2:1(^1) = A3, X2{ti) = A5, Xs{ti) = As- 



(5.21) 

Through defining 

y = {xi,X2,X3,x[,x'2,x'^f, 

and due to the positive definiteness of M, the boundary problem (I5.20p - (l5.2ip can be 
reformulated as follows: 

(5.22) y 
with the boundary condition 

(5.23) y{to) =( yit. 



h 

-M-^N 







x{ti] 
d 



where I3 is the 3x3 identity matrix, x{ti) = (A3, A5, Xq)'^ and the matrice M, N and a 
are defined by (ESI), (EHD and (I2.15P while c, d G are to be known. 

By the variation-of-constants formula, the problem (I5.22p -f l5.23p is equivalent to 

*^ ^ $(ti -t)M-ia 
^(ti -t)M-ia 



(5.24) 
with 



Hh - to)c 
^(ti -to)c 



to 



dt 



x{ti] 
d 



*W :=/3 + Erl(l5T(-M-liV)^ 

In the second equation of (I5.24p . d is uniquely determined by c. So we only need to 
consider the solvability of c through the first equation of (I5.24p . 

By the definition of the matrice M's, M'^^NM'^ and P in (I^HID and d^TT]) . it 
follows from the definition of $(t) that 

\PMH{t)M-hpT = /3 + _^^^.pM-hNM-hpTf 
(5 25) / 7fa^i^(v^^) 0^ 

1 



V 



22 



Thus we obtain (I) from the invertibihty of — to)- The proof of (II) can be obtained 
by direct calculations in this case ^{ti — to) is a singular matrix. □ 
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